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Recently, the topic of addressing clinical relevance on 
the top of statistical significance in the analysis of RCTs 
has been paid increasing attention. Several formal cri- 
teria to serve this purpose have been published. 

In this talk we present a framework which allows to 
investigate the impact of applying such formal criteria, 
independent of the scale of the outcome variable. The 
only assumption made is that we have one clinical trial 
correctly powered to achieve a 90% power. All treatment 
effects are then expressed as fractions of the assumed 
effect. 

In a first step we quantify the actual risk of having 
accepted a treatment with an irrelevant effect in a suc- 
cessful RCT, and we find this risk to be often rather 
small. In a second step we investigate two popular cri- 
teria based on comparing the effect estimate or the 
lower bound of the confidence interval with a given 
threshold. We demonstrate their equivalence in large 
samples and quantify the impact of applying them in 
terms of decreasing the risk of accepting a treatment 
with an irrelevant effect and increasing the risk of failing 
to accept a treatment with a relevant effect. 

Putting weights on these two types of errors, we can 
demonstrate that the formal criteria do often more harm 
than good. We discuss implications of these results on 
adapting sample sizes to demonstrate clinical relevance 
and on the application of the formal criteria if several stu- 
dies are summarized in a meta-analysis. 
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